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Abstract 

CLIL keeps on gaining ground in the European educational context, one clear 
example is Spain, where the number of schools adopting this methodology has 
kept growing exponentially in recent years. The present study has a dual perspec¬ 
tive looking at the motivation of students towards English and CLIL and showing 
students’ receptive vocabulary outcomes. All students (n=403) enrolled in secon¬ 
dary education in a bilingual school fulfilled a questionnaire and completed two 
receptive vocabulary level tests (VLT 2k and 3k bands). The findings of the study 
report on all learners’ opinions and it also correlates vocabulary outcomes from 
students of the last year of compulsory education (16 years old) with their moti¬ 
vation towards English. Once we analysed the questionnaire and the 2k and 3k 
versions of the VLT, we concluded that the CLIL group scored higher in recepti¬ 
ve vocabulary tests due to their higher motivation, albeit differences were not 
found statistically significant (Kolmogorov-Smirnov-Lilliefors, Shapiro-Wilk, and 
Mann-Whitney tests). We attribute this lack of statistical significance to the irre¬ 
gular CLIL implementation in the school and the short experience of the school 
with this methodology. 
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Analizando toda una escuela AICLE: actitudes, motivacion y 
resultados en el vocabulario receptivo de los estudiantes 


Resumen 

El enfoque AICLE sigue tomando fuerza en el contexto educativo europeo. Un claro 
ejemplo es Espana, en donde el numero de escuelas que adoptan esta metodologla 
ha crecido de forma exponencial en los ultimos anos. El presente estudio adopta 
una perspectiva dual en tanto analiza la motivacion de los estudiantes frente al 
ingles y al enfoque AICLE, y a la vez muestra los resultados de los estudiantes en 
cuanto a su vocabulario receptivo. Todos los estudiantes (n = 403) matriculados 
en una escuela bilingue secundaria completaron un cuestionario y desarrollaron 
dos examenes de vocabulario receptivo (VLT Bandas 2ky 3k). Los resultados del es¬ 
tudio dan cuenta de las opiniones de todos los estudiantes y correlacionan los re¬ 
sultados de vocabulario de los estudiantes de ultimo ano de educacion obligatoria 
(16 anos) con su motivacion hacia el ingles. Una vez se analizaron el cuestionario y 
las versiones de la prueba VLT, se concluyo que el grupo AICLE tuvo resultados mas 
altos en las pruebas de vocabulario receptivo debido a su alta motivacion, aunque 
no se encontraron diferencias signifrcativas estadisticamente (pruebas de Kolmo- 
gorov-Smirnov-Lilliefors, Shapiro-Wilk, y Mann-Whitney). Atribuimos esta falta 
de signifrcacion estadistica a la implementacion irregular del enfoque AICLE en 
la escuela y la corta experiencia de la escuela con esta metodologla. 


Palabras clave: AICLE; vocabulario receptivo; actitudes; motivacion. 
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Analisando toda uma escola AICLE/CLIL: atitudes, motivacao 
e resultados no vocabulario receptivo dos estudantes 


Resumo 

A abordagem da Aprendizagem Integrada de Conteudos e de Lingua (AICLE/CLIL) 
continua ganhando forca no contexto educativo europeu. Um claro exemplo e a 
Espanha, onde o numero de escolas que adotam essa metodologia tem crescido 
de forma exponencial nos ultimos anos. Este estudo adota uma perspectiva dual, 
pois analisa a motivacao dos estudantes ante o ingles e a abordagem AICLE/CLIL, 
ao mesmo tempo que mostra os resultados dos estudantes no que se refere ao seu 
vocabulario receptivo. Todos os estudantes (n = 403) matriculados numa escola bi- 
lingue de ensino fundamental responderam a um questionario e desenvolveram 
dois exames de vocabulario receptivo (VLT Bandas 2k e 3k). Os resultados do estu¬ 
do dao conta das opinioes de todos os estudantes e correlacionam os resultados 
de vocabulario dos estudantes do ultimo ano de educacao obrigatoria (16 anos) 
com sua motivacao para 0 ingles. Uma vez analisados questionario e versoes do 
teste VLT, concluiu-se que o grupo AICLE/CLIL teve resultados mais altos nas pro- 
vas de vocabulario receptivo devido a sua alta motivacao, embora nao tenham 
sido encontradas diferencas significativas estatisticamente (testes de Kolmogo- 
rov-Smirnov-Lilliefors, Shapiro-Wilk e Mann-Whitney). Atribuimos essa falta de 
signifrcacao estatistica a implantacao irregular da abordagem AICLE/CLIL na es¬ 
cola e a falta experiencia desta com essa metodologia. 

Palavras-chave: AICLE/CLIL; atitudes; motivacao; vocabulario receptivo. 
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INTRODUCTION 

Nowadays one of the trendiest terms in the European educational scenar¬ 
ios is CLIL (content and language integrated learning) that refers to the use 
of a second or foreign language (FL) as a vehicle to learn the content of a 
school curricula subject. Yet CLIL is only a relatively new term, which ac¬ 
counts for an old educational method. Mehisto, Marsh, and Frigols (2008) 
remark how many centuries ago Latin was the language used for instruc¬ 
tional purposes at universities. However, as these authors note, the use of 
Latin was not CLIL in its purest form, since little attention was paid to ver¬ 
nacular languages, meanwhile the will to integrate vernacular and national 
languages in the school curricula is regarded as one of the main innova¬ 
tions of CLIL in comparison to old methodological similar approaches. 

This idea is not completely new either because, in Canadian and USA 
schools, a prototype of CLIL methodology was implemented by means 
of immersion programs as early as i960, although under a different la¬ 
bel: Content-based language teaching or Content-Based Instruction (CBI) 
(Mohan, 1986). 

In the last decades CLIL has emerged with force due to its attractive 
tenets but also due to the international climate enjoyed by Europe at the 
present time. As to the former, most proponents of CLIL mention the fol¬ 
lowing (Coyle, Hood, & Marsh, 2010; Marsh & Wolff, 2007; Mehisto, 2008; 
Mohan, 1986): 

• Language is regarded as an instrument to learn the content of a sub¬ 
ject in the school curricula. 

• The focus is on content rather than on language and its grammat¬ 
ical rules. 

• Language is learnt in a natural way in the classroom setting. Mohan 
(1986) says that "language ceases to be taught in isolation” and Coyle 
etal. (2010) add that"... it combines different concepts that have been 
treated as separate entities: CLIL is the point where language learn¬ 
ing and subject learning converge”. 

• It relates learning and language learning to the real world as Maths, 
History or Music are real things for learners. 

• It increases learners' exposure to the target language. 
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• CLIL prepares students for living in a society which is becoming more 

and more internationalised, increasingly global and multilingual. 

CLIL in Europe is characterised by a great diversity in its implemen¬ 
tation. Experiences differ among regions within the same country but 
also among schools in a single town. According to Eurydice's report (2005), 
this situation is closely linked to the autonomy given to countries, regions, 
communities, and schools. However, the diversity of experiences has to do 
with the lack of regulation or official guidelines, and more particularly 
a) teachers’ linguistic competence, b) teachers’ training, c) language level 
to be achieved by learners, and d) distribution of CLIL hours. For instance, 
in France, Poland or Hungary prospective CLIL students are selected based 
on their performance on entrance exams both on the target language and 
on subject knowledge. In contrast, in Spain, Germany, Finland or Sweden, 
CLIL is normally opened to every single student. We see, thus, that there 
are many differences regarding how CLIL is put into practice. 

The purpose of this paper is to look at how CLIL is implemented in 
a school in La Rioja in the secondary education setting and to look at 1) its 
effect on students’ linguistic competence and 2) their motivation. We fol¬ 
lowed these procedures 1) analysing their scores on different vocabulary 
tests and 2) asking learners about their views on CLIL. To provide the 
context for our research, we deem necessary to give a concise account 
of the situation of CLIL in La Rioja. 

To achieve this goal, we followed the most recent and up-to-date 
book on this issue: CLIL in Spain (Lasagabaster & Ruiz de Zarobe, 2010). In 
addition, for our review of CLIL in La Rioja we will also fall back on Fernan¬ 
dez Fontecha (2009, 2010). As stated by Fernandez Fontecha (2010), La Ri¬ 
oja is a monolingual community where immigration and tourism have 
a huge importance due to the culture of wine, The Way of St. James, and 
San Millan de La Cogolla, i.e. the cradle of the first Spanish words. This au¬ 
thor points out the existence of some initiatives designed to improve the 
teaching of foreign languages, such as the PILC Project ( Proyectos de In¬ 
novation Linguistica en Centros, i.e. School Language Innovation Projects) 
which consists of two different possibilities of using English or French in 
the classroom. These two types are: Type A) where the foreign language 
is used for greetings, routines, and instructions, and Type B) where part of 
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the curriculum is taught in the FL. This project has experienced a notice¬ 
able growth in presence and importance among schools: the number of 
schools involved has risen from 10 to 46 schools between 2003 and 2010. 

Bilingual Sections, a different way of CLIL in schools in La Rioja, are 
also introduced and explained in Fernandez Fontecha (2010) and, in this 
type of instruction, at least two subjects can be taught in a FL so long as 
the total number of hours taught in the foreign language does not surpass the 
50% of the total hours of the curriculum. 

So far we have briefly portrayed the situation of CLIL in La Rioja, and 
we can conclude that it is not consistent at all, as it occurs in Spain and Eu¬ 
rope. Nevertheless, in spite of its diversity CLIL seems to be effective and 
to produce good results, although empirical research in this respect is still 
scarce and it usually focuses on one single aspect (Lasagabaster & Ruiz de 
Zarobe, 2010) of CLIL, therefore results cannot be generalised. This paper 
attempts to describe how CLIL is implemented in a school in La Rioja by 
providing a wider and deeper picture focusing on students' attitudes and 
one aspect of their communicative competence. Before getting any deeper 
on the study, it is necessary to have a look at the literature about the top¬ 
ics of motivation, CLIL, and its relationship. 

The following paragraphs are devoted to reviewing the literature 
on the following areas of research 1) studies on learners' beliefs and atti¬ 
tudes towards foreign languages, 2) studies on attitudes towards English 
language teaching/learning both in CLIL and in non-CLIL settings, and 
3) empirical studies on the effect of CLIL. 

Regarding studies that have addressed the issue of attitudes towards 
language learning, we find Delfin de Manzanilla (2007) who shows that 
university learners are both internally and externally motivated towards 
language, they are willing to communicate in the FL, and they also hold 
positive attitudes towards foreign language speakers. 

Likewise university students have positive attitudes towards bilin¬ 
gualism (Mohideen Obeidat 2005). Research also points out that teachers 
are one of the main sources for motivation whether positive or negative. 
These results reported by Mohideen Obeidat (2005) are similarly found 
in Gonzalez Ardeo (2003), because the latter concludes that Spanish and 
Basque bilinguals and Spanish or Basque monolinguals university stu- 
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dents show positive attitudes towards English although they are reluc¬ 
tant to be taught in English. 

Other studies (Liuoliene & Metiuniene, 2006), apart from reaffirming 
the importance of motivation in the learning process do reveal that stu¬ 
dents' wishes and needs to work independently rely highly on their mo¬ 
tivation. These studies also indicate that the greater the motivation, the 
more autonomous students want to be in their learning process. In our 
opinion, this latter assertion can be related to one of the main assumptions 
advocated by CLIL: it fosters cognition and students’ independent learning. 

However, primary and secondary school students are not as moti¬ 
vated as elder learners regarding foreign languages (Karahan, 2007; Yas¬ 
sin et al, 2009). Research has shown that lower levels of motivation have 
to do with the minimum contact that these learners experience with the 
language outside the classroom context; they are not motivated to learn 
a language because they do not think it is useful for their everyday life. 
From our viewpoint, this difference in motivation between university stu¬ 
dents and younger learners may be related to their ages and the proximi¬ 
ty to the job market. University students and elder learners may consider 
that learning a foreign language could motivate them extrinsically i.e. help 
them to get a better job or a higher salary. 

Being aware of learners' attitudes towards foreign languages is of 
paramount importance for teachers and researchers, but being aware 
of learners’ attitudes towards language teaching methodologies is at least 
as important. As we have seen, studies have proved that teachers are one 
of the main driving forces in motivation; and we should not forget that 
the main bond between teachers and learners is the classroom context, 
i.e. the methodology the teacher uses. In this regard, it seems evident that 
teaching methodologies have a clear influence on making language learn¬ 
ing more or less appealing to learners. 

Savignon and Wang (2003) and Verma (2008) conducted research to 
ascertain university students'motivation and attitudes towards language 
learning. Regarding methodology, common findings are observed in these 
studies: students prefer, and are more motivated, with a communicative 
approach rather than with grammar-focused lessons. 
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Finally, these studies suggest again that teachers are the main moti¬ 
vator for learners. These results are in agreement with the ones attained by 
Lennartsson (2008) since the learners in this study also consider that teach¬ 
ers influence positively or negatively their attitudes towards language. 

To complete our review, we need to have a look at studies that have 
combined these attitudinal factors with learning in a CLIL context. First 
of all, we will focus on students' perceptions. These studies on students' 
perceptions on CLIL are still scarce and in our review, we must fall back on 
Dalton-Puffer et al. (2009), where we see the views of Austrian university 
students involved in a CLIL programme. The results provided by these au¬ 
thors are of great value to us, as their findings do not seem to be fortuitous: 
1660 former CLIL students answered a questionnaire and 20 students in¬ 
volved in CLIL completed a deeper interview. The main results obtained by 
Dalton-Puffer etal. are summarised as follows: a) CLIL encourages learners 
to talk and to think by themselves, b) they feel more motivated because 
the teacher is the language expert and the subject expert at the same time, 
c) students focus more on communication than on grammatical correct¬ 
ness, and d) CLIL lacks organization in the way it is implemented. Looking 
closely at these assertions we perceive that there is an agreement between 
students' views involved in a CLIL programme and the theoretical virtues 
attributed to CLIL. 

We will now focus on students’ attitudes towards CLIL. To this respect 
we will refer to two studies that have dealt with this issue in secondary 
school settings: Lasagabaster and Sierra (2009) and Yassin et al. (2009). 

On the one hand, the main objective in Yassin etal. (2009) is to docu¬ 
ment the experiences of learners and to ascertain their views towards the 
teaching of Science through English in Malaysia. The study was conducted 
with "Year 4” students and the main findings were that NLEP (Non-Limit¬ 
ed English Proficiency) learners, i.e. the CLIL-like group, have significantly 
more positive attitudes towards Science in English, greater parental sup¬ 
port, and more experience using the English language than LEP (Limited 
English Proficiency) learners. 

On the other hand, Lasagabaster and Sierra (2009) present the differ¬ 
ences in language attitudes between CLIL students and non-CLIL students 
EFL learners in secondary education in the BAC (Basque Autonomous Com- 
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munity). They focus on how gender and social class have an influence on 
motivation towards foreign languages. This study reports that students 
who are involved in a CLIL programme show better attitudes towards En¬ 
glish as well as towards other languages and find learning English easier 
than non-CLIL students. 

Research on the effect of CLIL on learners’ language competence is 
rather scarce when compared to the great number of studies on the im¬ 
plementation of CLIL or research on theories and principles of CLIL. More¬ 
over, its systematisation is rather complex. The reason is that the studies 
on the effectiveness of CLIL differ the following aspectstthe characteristics 
of the language learning contexts where CLIL was implemented, learners’ 
age and mother tongue, learners’ level in the target language, or the spe¬ 
cific dimension of learners’ competence that is investigated. 

Comparisons among the studies, let alone outcomes’ generaliza¬ 
tions, are risky due to the huge variation among the existing studies but 
also because of the lack of information regarding the number of hours of 
CLIL received by the learners participating in the studies. This information 
is needed to compare outcomes but unfortunately the number of hours of 
CLIL is not reported in most studies. 

Most studies on the effectiveness on CLIL reveal, as theory and learn¬ 
ers’ views pointed out, that this approach entails better results for learners 
in most aspects of communicative competence and language skills as for 
instance: pronunciation, syntax, pragmatics, informal use of language, or 
reading comprehension, or writing (Admiraal etal, 2005; Agustin Llach & 
Jimenez Catalan, 2007; Dalton-Puffer, 2007; Huttner & Rieder-Bunemann, 
2007; Llinares & Whittaker, 2007; Jimenez Catalan & Ruiz de Zarobe, 2009; 
Sylven, 2010). In the following paragraphs we give a brief account of some 
of the studies that have focused on the effect of CLIL on dimensions of EFL 
learners' lexical competence. 

CLIL has been proved to have a positive influence on lexical compe¬ 
tence as shown in Jimenez Catalan etal. (2006) where they acknowledged 
that CLIL learners display higher lexical richness and sophistication in the 
vocabulary they use in compositions, as well as higher receptive vocab¬ 
ulary knowledge as measured by the 1000 and 2000 frequency bands of 
Vocabulary Levels Test (VLT). 
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This study is not the only one to ascertain differences in favour of 
CLIL. Agustin Llach and Jimenez Catalan (2007) studied how the type 
of instruction affected lexical reiteration and productive vocabulary in 
written texts; results confirm again that students involved in a CLIL en¬ 
vironment perform better than non-CLIL learners. However, they also re¬ 
mark that both CLIL and EFL learners resort to repetition rather than to 
synonyms or antonyms suggesting similar mechanisms of lexical cohe¬ 
sion by CLIL and EFL learners. 

Ruiz de Zarobe and Jimenez Catalan (2009) edited a book that encom¬ 
passes different studies that compare CLIL learners to non-CLIL learners 
with respect to different aspects of lexical competence such as receptive 
vocabulary, word association, and transfer between languages (Span- 
ish-English) or use of inflected forms in English among others. In all cas¬ 
es but one CLIL students achieved better results than non-CLIL learners. 

Apart from the mentioned competences, there are other extra linguis¬ 
tic aspects that have been studied i.e. the effects of extramural exposure to 
English on learners' vocabularies (Sylven, 2006). Sylven argues that CLIL 
students have more contact with English outside the school than non-CLIL stu¬ 
dents and this greater amount of exposure affects positively their self-as¬ 
sessment in English. 

In a latter longitudinal study (Sylven, 2010) differences in vocabu¬ 
lary size between a group of CLIL students and a group of EFL students 
are contrasted too. She reports that CLIL students performed better in all 
tests; however she highlights the importance of the exposure to English 
outside the class because some EFL students, those who affirmed having a 
wide contact with English outside the class—e.g. reading, T.V., Internet— 
were among the top scorers. 

This fact leads us to the amount of exposure, a controversial issue in 
the field of language learning. Miralpeix (2007) studied the influence of ex¬ 
posure with regards to language learning. This study reveals that one group 
with greater exposure within the class -74 hours more- performed simi¬ 
larly to two other groups that had received less exposure to English. This 
fact leads us to think about the importance of methodology; since these 
findings seem to contradict studies where learners with more hours of ex¬ 
posure through CLIL have better results (Jimenez & Ruiz de Zarobe, 2009). 
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To close this review on studies on the effectiveness of CLIL and EFL 
learners’ competences, we find mandatory to comment on that some re¬ 
searchers make clear that CLIL students are more motivated than non-CLIL 
students and it influences their achievement (Admiral el al, 2005; Sylven, 
2006; Huttner & Rieder-Bunemann, 2007). These findings are key to our 
study because we will see the role that motivation plays in students’ FL 
vocabulary results. 

In the earlier paragraphs, we have attempted to review studies on 
learners’ beliefs, attitudes and motivation towards CLIL. As we have seen 
that, although scarce, there is research on almost every variable involved 
in CLIL: teachers, learners, subjects, CLIL activities, and language learning 
contexts. However, as far as we know, there is no research that looks at the 
main participants in the CLIL experience within the same school, let alone 
through a whole educational stage. 

Most studies give a partial view of CLIL as they focus on one single 
aspect. In our opinion, to advance in the understanding of CLIL, it is nec¬ 
essary to adopt a more comprehensive view that may provide a more de¬ 
tailed picture on the beliefs, attitudes, motivations and practices of the main 
participants in the CLIL experience. Therefore, in the study reported in this 
paper we set out to investigate learners’ views on CLIL and learners’ atti¬ 
tudes towards English and CLIL under the same scenario: the school where 
CLIL is being implemented. We do not set out to look at CLIL with precon¬ 
ceptions; rather we attempt to give a description of its reality by means of 
asking learners themselves. We believe that the adoption of a comprehen¬ 
sive approach in our study will provide us with invaluable data to identi¬ 
fy strengths but also to detect possible weaknesses in the early stages of 
implementation of CLIL in the community of La Rioja. 

METHOD 

Informants 

The study encompasses the school’s whole population as regards secondary 
education (SE) in the school year 2009-2010. The population encompass¬ 
es 403 students distributed among the four compulsory years of Spanish 
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secondary education. Students' ages range from 12 to 16. Table 1 shows the 
distribution of students by school grade and age range. 

Table 1. Distribution of students by school year and age range 


Grade 

1st year 

2nd year 

3rd year 

4th year 

N 

104 

99 

108 

92 

Age range (years) 

12-13 

13-14 

14-15 

15-16 


Regarding their mother tongue, most students are monolingual 
speakers of Spanish as Li, whereas a small group of students have Spanish 
as L2. Their mother tongues are: Romanian, Arabic, Bulgarian, Catalan, Chi¬ 
nese, Russian, Senegalese, and Urdu. 1 The distribution of students’ mother 
tongues is displayed in Table 2. 

Table 2. Distribution of students by mother tongue 


Li Language 

No. of Students 

Spanish 

392 

Romanian 

4 

Arabic 

1 

Bulgarian 

1 

Catalan 

1 

Chinese 

1 

Russian 

1 

Senegalese 

1 

Urdu 

1 


At this point it is necessary to make a further description of the char¬ 
acteristics of CLIL throughout the fourth grades in the school we investi¬ 
gate. The main difference between CLIL and non-CLIL groups lies in the fact 
that the former received additional hours of exposure to English language 
by means of CLIL methodology. However, the number of hours is far from 


1 Spanish native speakers born in South or Central America are not included in this 
group; they belong to the Spanish natives group according to our classification. 
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being equal, neither throughout the grades nor within each grade. Regard¬ 
ing CLIL, the situation of the school is rather complex and needs clarifica¬ 
tion, thus we tackle this issue in the following paragraphs. Figure 1 shows 
the distribution of students by type of instruction per year. 

Figure i. Distribution of students by type of instruction per year 


CLIL Vs. Non-CLIL instruction 



12 3 4 

S.E year 


In the 1 st year, only 3 out of 105 students had had some previous CLIL 
experience throughout primary education. However, the number of hours 
of exposure to English could not be calculated; the reason is that these 
three students were new to the school and it was not a goal of this study 
to trace learners’ previous CLIL experience in other schools but to focus on 
CLIL in one specific school. 

In the 2 nd year, 28 out of 99 students had studied at least one subject 
through CLIL. However, the total number of hours could not be calculated 
either because the teacher in charge of the CLIL subject had left the school 
or because the students studied the CLIL subjects at a different school. 

In the 3 rd year, the clear majority of students (96 out 108) had had 
some CLIL experience. The total number of CLIL hours per student ranges 
from 10 to 30 depending on the subjects studied through English. Figure 
2 shows the number of CLIL hours that students received. 

In the 4 th year, a high percentage of students had had CLIL experience: 
75 out of 94. In this case, students had been taught from one to three sub¬ 
jects in English. The total number of CLIL hours ranges from 10 to 90 de¬ 
pending on the different subjects studied by the informants all along the 
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four years of secondary education. Figure 3 shows the distribution of 4 th 
year students by the number of hours of CLIL instructions they received. 


Figure 2. Distribution of 3rd year students 
by the amount of CLIL hours received 



Figure 3. Distribution of 4th year students 
by the amount of CLIL hours received 

CLIL hours S.E 4th year 


35 



No CLIL Up to 15 15 to 30 30 to 60 60 to 90 

Total amount of hours 


Data collection instruments 

Students were asked to fill in a questionnaire designed ad hoc of the task, 
which was based on the same questionnaire used by the GLAUR group 
(Grupo de Linguistica Aplicada de la Universidad de La Rioja - Applied Lin¬ 
guistics Group of the University of La Rioja). Some questions were added 
asking information about the students' CLIL experience and their percep¬ 
tions and attitudes on it. 
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Procedures 

Once the data gathering was completed, we proceeded to type the ques¬ 
tionnaires' results and finally, after having typed the responses to the 
questionnaire we proceeded to the quantitative analysis of the data, which 
was completed using different statistic tests (including here Kolmogor- 
ov-Smirnov-Lilliefors, Shapiro-Wilk, and Mann-Whitney among others 
tests) where needed by means of SPSS. 2 

RESULTS 

In this section, we attempt to answer the research questions posed earlier 
by providing data elicited from students and teachers belonging to a CLIL 
school. In the first place, we provide the data obtained from students on 
their views on CLIL and their attitudes towards English. 

Students' views on CLIL 

Regarding our first research question the answer is negative since accord¬ 
ing to more than 80% of the students, CLIL is not considered as a useful 
experience. Figure 4 reveals that most of the students who had received 
CLIL instruction report that CLIL was either of'very little help’ or 'little help’. 
None of the students considered CLIL as 'very helpful'. Figure 4 shows the 
distribution of responses given by students regarding their views on CLIL. 

Regarding our second research question, 'What skills have students 
improved most by means of CLIL?’ two tendencies clearly emerge in the 
data shown in Figure 5. In the first place, a great number of students re¬ 
ported 'listening’ and 'speaking’ as the most positively influenced skills. 

Secondly, we see that 3 rd year followed by 4 th year are the courses 
that concentrate the highest number of students who report CLIL to have 
been of help in the improvement of their linguistic skills (mainly listen¬ 
ing). Contrary to what might have been expected, a noticeable percentage 
of students felt that CLIL had not boosted any of their skills. 


2 We would like to acknowledge Montserrat San Martin, lecturer at the Mathematics 
and Computing Department of the University of La Rioja, for her invaluable help in 
test selection and statistical data analysis. 
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Figure 4. Distribution of responses given by students 
regarding their views on CLIL 


Is CLIL helpful according to students? 


100 



N/A Not Very little Little Quite Very 
helpful 


Also, as we can observe in Figure 5, vocabulary is included togeth¬ 
er with the four skills. The reason for its inclusion here is that all the stu¬ 
dents who believed that CLIL had helped them in the improvement of the 
four language skills also referred to the positive effect of CLIL on the de¬ 
velopment of their lexicons. Figure 5 shows the distribution of skills im¬ 
proved in each course. 

Figure 5. Distribution of skills improved per course 


Skills improved by CLIL according to students 
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Linguistic skills 


Students’ attitudes towards English 

We now turn our attention towards students' attitudes towards English 
(RO3), including here the two groups of students: CLIL and non-CLIL. To 
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this purpose, both groups were asked to rate English according to an at- 
titudinal scale made up of positive and negative. The minimum score is 1 
and the maximum 7. The means show that CLIL students and non CLIL stu¬ 
dents hold very similar attitudes towards English language, although the 
means are slightly higher for the CLIL group throughout the four years. A 
close look at Table 3 reveals that the highest scores, therefore the most mo¬ 
tivated students, were obtained by CLIL students in the last year of Span¬ 
ish Secondary Education: 4 th ESO. 


Table 3. CLIL and non-CLIL students’ attitudes towards English 


Year 

CLIL 

N 

Mean 

S.D. 

1st year 

No 

101 

5.5000 

0.88829 

Yes 

3 

5.6250 

0.78062 

2nd year 

No 

69 

5.5236 

0.94136 

Yes 

28 

5.5625 

0.69264 

3rd year 

No 

13 

5.2692 

1.47624 

Yes 

95 

5.6018 

1.03188 

4th year 

No 

19 

5-5977 

0.58097 

Yes 

73 

5.7072 

0.66836 


Although CLIL students score higher in their attitude towards En¬ 
glish all through the four years, these differences were not statistically 
significant, as the results of Mann-Whitney U test applied to the means 
gave us the following values 3 as regards i st year (U = 137; z = 0.778), 2 nd year 
(U = 917.5; z = 0.699), and 3 rd year (U = 556; z = 0.561). 

Regarding 4 th year, the t-test 4 performed showed non-significant dif¬ 
ferences either between CLIL and non-CLIL students. Results show a high 
value (t = 0.516) and we cannot affirm that these are significant because 
the p-value should be less than 0.05 (p < 0.05). 


3 The Kolmogorov-Smirnov-Lilliefors Test run for normality testing showed the sample 
did not have a normal distribution (p < 0.05). 

4 The Kolmogorov Smirnov-Lilliefors Test showed that the sample had a normal distri¬ 
bution (p > 0.05); thus as the assumption of normality was met, a parametric test was 
used to compare the two groups. 
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Students' vocabulary outcomes 

In this section we present the results obtained by our informants in the re¬ 
ceptive VLT in its 2000 and 3000 words band version. It must be said that 
due to space limitations here we present solely the results corresponding 
to 4 th year of ESO. The reason for focusing exclusively on this course rath¬ 
er than the other three is that 4 th ESO stands for the final stage of Span¬ 
ish secondary education. Furthermore, we will also present the results 
obtained from analysing the relationship between attitudes towards En¬ 
glish, presented above, and students’ achievement measured by means of 
VLT 2000 and VLT 3000. 

As expected, both groups obtained higher scores in the VLT 2k rath¬ 
er than in the VLT 3k and differences between CLILs and non-CLILs are also 
greater in the former test. Figure 6shows the 4 th year CLIL and non CLIL stu¬ 
dents' scores in VLT 2k and 3k. 


Figure 6.4th year CLIL and non CLIL students’ scores in VLT 2k and 3k 


VLT Results in S.E 4th year 



□ CLIL 
■ Non-CLIL 


Although we find differences in favour of CLIL students, these were 
found not to be significant after analysing them statistically. As the re¬ 
sults of Mann-Whitney U test applied to the means gave us the follow¬ 
ing values as regards VLT200 (U = 603.5; z = 0.384), and VLT300 (U = 690; 
z = 0.973). 5 The Kolmogorov-Smirnov for contrasting two samples was also 


5 The Kolmogorov-Smirnov-Lilliefors Test run for normality testing showed the sample 
did not have a normal distribution (p < 0.05). 
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applied to the data to search for significance, again non-significant differ¬ 
ences were found between CLIL and non-CLIL students concerning their re¬ 
sults on VLT2000 due to the high values (t = 0.646) and VLT3000 (t = 0.927). 

Relation between students' attitudes and vocabulary outcomes 

We present here evidence for the relationship between students’ atti¬ 
tudes towards English language and vocabulary outcomes as measured by 
VLT2000 and VLT300. In this regard, there is a positive correlation (Spear¬ 
man test) between attitudes and scoring in each VLT frequency band, and 
this correlation applies to all students, that is, those who had contact with 
CLIL and those who did not. In other words, the more motivated the stu¬ 
dents are about English, the better their vocabulary. 

The results tell us that there is a significant increasing relationship 
between students' attitudes towards English and their vocabulary per¬ 
formance. The values obtained were as follows: r = 0.420, p < 0.000 for 
VLT2000, and r = 0.349 ,P <0.001 for VLT3000. The significant correlation 
suggests that the better the attitudes towards English the better the per¬ 
formance on the two bands analysed from VLT test. It does not matter if 
the students have received any kind of CLIL instruction or not. 

Thep-values (0.000 in VLT 2000 and 0.001 in VLT 3000) are less than 
0.05, which indicates that the relation between attitudes and outcomes is 
significantly different. Furthermore the r-values higher than 0.00 (0.420 
for VLT 2000 and 0.349 for VLT 3000) indicate that this is an increasing 
relation: the higher the score in motivation, the better the results in VLT 
2000 and VLT 3000. 

DISCUSSION 

The results of our study provide us with different kinds of evidence on var¬ 
ied issues like students’ motivation towards English or the perceptions that 
they have on CLIL. We try to provide a valid interpretation to these results 
in the following lines. 

Concerning students’ motivation, our results suggest that although 
EFL and CLIL students get similar scores, students receiving some kind of 
CLIL instruction show better attitudes towards English as compared to 
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those students that are not involved in content teaching. Nevertheless, 
our findings are not limited to this fact because, as it was explained in the 
previous section, there is a strong link between motivation and achieve¬ 
ment since the more motivated students are also the ones that obtained 
the highest scores regardless of their instruction. 

Our results seem to match those attained by Perez (2006) and Inal, 
Evin, and Saracaloglu (2007) where authors stress the importance of the 
positive relationship that binds motivation to achievement. However, there 
is one main difference if we are to compare their studies with ours: the 
age of informants. Our informants are in the last year of the secondary ed¬ 
ucation, i.e. 15 to 16 years, whereas their informants were already univer¬ 
sity students, so they were at least 18 years old by the time their studies 
had been carried out. 

As we have seen, we can see a difference in age but also a similari¬ 
ty in the motivation-achievement relationship. This leads us to think that 
the influence that motivation has on achievement might remain, at least, 
stable throughout different educational stages, as we have seen. 

Regarding motivation, we mean to fulfil and answer at the same 
time one of our research questions: Does CLIL affect students'motivation? 

Other studies make clear that students from primary levels (Kara- 
han, 2007; Yassin et al, 2009), through to secondary levels (Lasagabaster 
& Sierra, 2009) and university students (Gonzalez Ardeo, 2003; Savignon & 
Wang, 2003; Mohideen Obeidat, 2005; Delfin de Manzanilla, 2007; Len- 
nartsson, 2008; Verma, 2008; Dalton-Puffer et al, 2009) have positive 
attitudes towards other languages different to their Li due to different 
and varied internal and external factors, and our results appear to be in 
line with them, because our informants from the 4 courses presented high 
scores, on average, when they were asked to evaluate English. 

Similar to our study is the one conducted by Lasagabaster and Sier¬ 
ra (2009) because their informants are the same age as ours and both of 
us measured students’ attitudes towards English by means of the same 
item of the given questionnaire therefore we can establish an interesting 
comparison with their study. 

We compared our informants' attitudes with the mentioned study 
and we realized that in Lasagabaster and Sierra, CLIL groups had signifi- 
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cantly better attitudes than EFL groups. This might be possibly due to a 
greater amount of exposure to English in favour of their informants. We 
do not think that the socioeconomic context of the informants in each of 
the studies can make a big difference because the cities where both ques¬ 
tionnaires were administered on areas in the North of Spain and not far 
from each other. 

Nevertheless, it is very important from our point of view noting that 
there is a great difference between the cultural contexts: English is L2 for 
our informants whereas English is L3 for Lasagabaster and Sierra's infor¬ 
mants. It implies that their informants live in a multilingual community 
and they might have developed more positive attitudes towards languag¬ 
es than our informants. 

In addition, although the number of hours of exposure to English is 
not made clear in Lasagabaster and Sierra, we tend to think that their in¬ 
formants might have received a greater exposure. According to previous 
studies (Sylven, 2006; 2010), a greater amount of exposure to the foreign 
language has a positive influence on the learner's attitude towards it. 

Nevertheless, it is important not to forget that CLIL is still in a prelim¬ 
inary stage in La Rioja, let alone the school of our study. Therefore we think 
that, for the moment, a greater emphasis should be put on the amount of 
hours while CLIL undergoes a global process of standardization. We have 
noticed that the implementation of this methodology is somewhat irreg¬ 
ular in the school under study and it might have had a negative effect on 
students' attitudes. 

In the process of developing the study we also interviewed 2 CLIL 
teachers and 2 EFL teachers about the situation of the school regarding 
bilingualism, but we decided not to include their opinions in the frame 
of this study. However, their opinions might help to understand why stu¬ 
dents' outcomes in vocabulary are not as high as it could be expected from 
the circumstances. 

On the one hand, CLIL teachers were highly motivated about the 
use of this methodology although they affirmed that they did not have 
as much time as they would like to devote to prepare classes and materi¬ 
als, which, by the way, according to them were also very limited in num¬ 
ber and quality for their subjects, namely Religion and Mathematics. From 
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the conversations with them, we could infer that although the intention 
and motivation to perform a better CLIL were high, they acknowledged the 
actual implementation did not meet their expectations and more work 
needed to be done. 

On the other hand, EFL teachers provided a more pessimistic ap¬ 
proach towards CLIL and thought that it could be improved overall because 
students were not showing noticeable improvements in their learning. 

These perspectives provide us with a different point of view about 
the school and let us see that CLIL implementation is somewhat irregular, 
what goes in line with the global European situation where CLIL does not 
follow a set of standardized processes. It might justify students’ motiva¬ 
tion, perspectives, and outcomes. 

CONCLUSION 

By means of questionnaires and tests we have tried to provide a bird’s-eye 
view on a whole single CLIL secondary Spanish school, something that had 
not been done previously as far as we are concerned. We have done that 
by presenting students’ perceptions on CLIL and their results on vocabu¬ 
lary, and to a lesser extent, teachers’ opinions. 

We have tried to fulfil three main objectives and to do that, we pro¬ 
posed some research questions, which we think, have been answered. Re¬ 
sults have proved on one hand that CLIL seems to have a positive effect on 
students, as it was expected. However these interpretations should be tak¬ 
en with extreme care because statistical tests affirmed that the positive dif¬ 
ferences in favour of CLIL students were not significant. We attribute the 
lack of significance to the irregular implementation of CLIL in the school 
because a poor implementation of CLIL might affect negatively learners’ 
opinions and motivation. 

On the other hand, results showed that although different teach¬ 
ers have different approaches to CLIL, teachers and students’ perceptions 
match up when it comes to the linguistic skills that students are supposed 
to have improved after having been involved in a CLIL context. Even though 
we did not run any tests to find the relevance between learners’ opinions 
and their vocabulary outcomes, we tend to think that these results could 
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have been higher if learners perceived CLIL as a more organized and stan¬ 
dardized method. 

These interpretations should also be cautiously considered due to the 
relatively pioneer character of the work and, also due to this fact: there is 
room for further studies which may aim at investigating and helping to 
improve CLIL. 

In order to close the article we must make reference to the implica¬ 
tions that this study might have for teachers and researchers. In the first 
place, from our point of view, it is obvious that Spanish students need a 
higher competence in English if CLIL is meant to be successful, because 
both CLIL and EFL teachers confirmed that they considered that learners 
had a low competence and it hindered them from using English as the ve¬ 
hicular language all year long. 

Besides we have also learnt that attitudes towards languages have 
a significantly positive influence on students' achievement; therefore, 
teachers should really make an effort to enhance their pupils' motivation 
and attitudes, in this case towards English, because different studies place 
teachers as one of the main driving forces in language learning. 
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